Scalable and secure analytic model integration and deployment platform

ABSTRACT

According to some embodiments, system, apparatus and methods are provided comprising an analytic model for an installed product; an execution platform configured to execute the analytic model; an application programming interface (API) wrapper associated with each of the analytic model and the execution platform, the API wrapper including input information, output information and a technique; and a storage in communication with the analytic model and the execution platform and storing program instructions to perform the functions as follows: transmitting information between the analytic API wrapper and the execution platform API wrapper; and deploying the analytic model to the execution platform based on the transmitted information. Numerous other aspects are provided.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/338,951, entitled “SCALABLE AND SECURE ANALYTIC MODEL INTEGRATION ANDDEPLOYMENT PLATFORM,” filed on Oct. 31, 2016, the entire disclosure ofwhich is incorporated herein by reference. The present application isrelated to U.S. patent application Ser. No. 15/338,839, filed Oct. 31,2016, entitled “System Architecture for Secure and Rapid Development,Deployment and Management of Analytics and Software Systems”, U.S.patent application Ser. No. 15/338,922, filed Oct. 31, 2016, entitled“Integrated Development Environment for Analytic Authoring”, and U.S.patent application Ser. No. 15/338,886, filed Oct. 31, 2016, entitled“Self-Aware and Self-Registering Software & Analytics PlatformComponents,” all of which are hereby incorporated herein by reference intheir entirety for all purposes.

BACKGROUND

It is often desirable to make assessment and/or predictions regardingthe operation of a real world physical system, such as anelectro-mechanical system.

Conventionally, models are used to analyze data and generate resultsthat may be used to make assessments and/or predictions of the physicalsystem. Models may be an important aspect in making industrial systemsfunction efficiently. A model may be built on a local computer and thenthe model is transmitted to another computer to be executed. However,running the model on a computer different from where it was built mayinvolve re-writing the model program and de-bugging the program, whichmay be very time consuming and error-prone. This re-writing/de-buggingprocess may be repeated each time the model is run on another system.

It would therefore be desirable to provide systems and methods tofacilitate model construction for a physical system in a more efficientand accurate manner.

BRIEF DESCRIPTION

According to some embodiments, a system includes an analytic model foran installed product; an execution platform configured to execute theanalytic model; an application programming interface (API) wrapperassociated with each of the analytic model and the execution platform,the API wrapper including input information, output information and atechnique; and a storage in communication with the analytic model andthe execution platform and storing program instructions to perform thefunctions as follows: transmitting information between the analytic APIwrapper and the execution platform API wrapper; and deploying theanalytic model to the execution platform based on the transmittedinformation.

According to some embodiments, the method includes providing an analyticmodel for an installed product; providing an execution platform toexecute the analytic model; providing an application programminginterface (API) wrapper associated with each of the analytic model andthe execution platform, the API wrapper including input information,output information and a technique; and deploying the analytic model tothe execution platform based on communication between the analytic modelAPI wrapper and the execution platform API wrapper.

A technical effect of some embodiments of the invention is an improvedtechnique and system for rapid development and deployment of an analyticand software system. With this and other advantages and features thatwill become hereinafter apparent, a more complete understanding of thenature of the invention can be obtained by referring to the followingdetailed description and to the drawings appended hereto.

Other embodiments are associated with systems and/or computer-readablemedium storing instructions to perform any of the methods describedherein.

DRAWINGS

FIG. 1 illustrates a system according to some embodiments.

FIG. 2 illustrates a system architecture according to some embodiments.

FIGS. 3A and 3B illustrates a component and execution platform accordingto some embodiments.

FIG. 4 illustrates a flow diagram according to some embodiments.

FIG. 5 illustrates an interface according to some embodiments.

FIG. 6 illustrates an interface according to some embodiments.

FIG. 7 illustrates an interface according to some embodiments.

FIG. 8 illustrates an interface according to some embodiments.

FIG. 9 illustrates an interface according to some embodiments.

FIG. 10 illustrates a block diagram of a system according to someembodiments.

FIG. 11 illustrates a deployment diagram according to some embodiments.

FIG. 12 illustrates a block diagram of the artifact module according tosome embodiments.

FIG. 13 illustrates a block diagram of the system according to someembodiments.

DETAILED DESCRIPTION

In the following detailed description, numerous specific details are setforth in order to provide a thorough understanding of embodiments.However, it will be understood by those of ordinary skill in the artthat the embodiments may be practiced without these specific details. Inother instances, well-known methods, procedures, components and circuitshave not been described in detail so as not to obscure the embodiments.

It is often desirable to make assessment and/or predictions regardingthe operation of a real world physical system, such as anelectro-mechanical system.

Conventionally, computational models are used to analyze data andgenerate results that may be used to make assessments and/or predictionsof the physical system. Models may be an important aspect in makingindustrial systems function efficiently. A model may be built on a localcomputer and then the model may be transmitted to another computer forexecution. However, running the model on a computer different from whereit was built may involve re-writing and/or debugging the model program,which may be very time consuming. This re-writing/de-bugging process maybe repeated each time the model is run on another system. Additionally,industrial-grade systems may be complex and may involve hundreds ofbuilding blocks to work together seamlessly in production environments.Each block may be managed over its lifecycle to preserve the overallproduct integrity. As the blocks evolve, it may be difficult to managethe dependencies and handoffs between these blocks. Another challengewith conventional systems may be that not all blocks change at the sametime, therefore the blocks may need to be managed individually,sometimes keeping different versions of the same blocks running inparallel. Building these conventional systems may involve large teams ofdevelopers with multiple technical backgrounds to work together to buildthe system.

An example of a model may be a Remaining Useful Life (“RUL”) model thatmay predict a remaining useful life of an electro-mechanical system,such as an aircraft engine, to help plan when the system should bereplaced. Likewise, an owner or operator of a system might want tomonitor a condition of the system, or a portion of the system to helpmake maintenance decisions, budget predictions, etc.

Some embodiments relate to digital twin modeling. “Digital twin” stateestimation modeling of industrial apparatus and/or other mechanicallyoperational entities may estimate a RUL of a twinned physical systemusing sensors, communications, modeling, history and computation. It mayprovide an answer in a time frame that is useful, that is, meaningfullypriori to a projected occurrence of a failure event or sub-optimaloperation. The information may be provided by a “digital twin” of atwinned physical system. The digital twin may be a computer model thatvirtually represents the state of an installed product. The digital twinmay include a code object with parameters and dimensions of its physicaltwin's parameters and dimensions that provide measured values, and keepsthe values of those parameters and dimensions current by receiving andupdating values via outputs from sensors embedded in the physical twin.The digital twin may have respective virtual components that correspondto essentially all physical and operational components of the installedproduct.

As used herein, references to a “digital twin” should be understood torepresent one example of a number of different types of modeling thatmay be performed in accordance with teachings of this disclosure.

The term “installed product” should be understood to include any sort ofmechanically or electronically or chemically operational entity,including, but not limited to, jet engines, locomotives, gas turbines,and wind farms. The term is most usefully applied to large complexsystems with many moving parts and numerous sensors installed in thesystem. The term “installed” includes integration into physicaloperations such as the use of engines in an aircraft fleet whoseoperations are dynamically controlled, a locomotive in connection withrailroad operations, or apparatus construction in, or as part of, anoperating plant building.

As used herein, the term “automatically” may refer to, for example,actions that may be performed with little or no human interaction.

Embodiments provide for minimal set-up time of a development environmentfor new platform developers.

FIG. 1 is a block diagram of a system 100 provided according to someembodiments. The system 100 may include a plant or “installed product”102. As noted above, the installed product 102 may be, in variousembodiments, a complex mechanical entity such as the production line ofa factory, a gas-fired electrical generating plant, a jet engine on anaircraft amongst a fleet, a wind farm, a locomotive, etc. The installedproduct 102 may include a considerable (or even very large) number ofphysical elements 104, which for example may include turbine blades,fasteners, rotors, bearings, support members, housings, etc.

The system 100 may include a platform 200 that may host a computer datastore 106 (e.g., storage), a modeling module 108 and other elements 109.The computer data store 106 may provide information to the modelingmodule 108 and may store results from the modeling module 108. Theplatform 200 and the modeling module 108 may include one or moreprocessing elements 116. The processor 116 may, for example, be aconventional microprocessor, and may operate to control the overallfunctioning of the platform 200 and the modeling module 108.

In one or more embodiments, the data store 106 may comprise anycombination of one or more of a hard disk drive, RAM (random accessmemory), ROM (read only memory), flash memory, etc. The data store 106may store software that programs the processor 116 and the modelingmodule 108 to perform functionality as described herein. Data in thedata store 106 may also include, for example, information about physicalelements 104 of the installed product 102, such as historic enginesensor information about a number of different aircraft engines andprior aircraft flights (e.g., external temperatures, exhaust gastemperatures, engine model numbers, takeoff and landing airports, etc.).

The modeling module 108, according to some embodiments, may access thedata store 106 and utilize a model creation unit or task module 110 tocreate an analytic model that may be used to create a prediction and/orresult that may be transmitted to at least one of various user platforms112, back to the installed product 102 or to other systems 114, asappropriate (e.g., for display to a user, operation of the installedproduct, operation of another system, or input to another system). Asused herein, the term “predictive model” and “analytic model” may beused interchangeably.

The modeling module 108 may be programmed with one or more softwarecomponents that may model individual elements 104 that make up theinstalled product 102.

A communication channel 118 may be included in the system 100 to supplydata from at least one of the installed product 102 and the data store106 to the modeling module 108.

In some embodiments, the system 100 may also include a communicationchannel 120 to supply output from one or more models in the modelingmodule 108 to at least one of user platforms 112, back to the installedproduct 102, or to other systems 114. In some embodiments, signalsreceived by the user platform 112, installed product 102 and othersystems 114 may cause modification in the state or condition or anotherattribute of one or more physical elements 104 of the installed product102.

Although not separately shown in the drawing, one or more control units,processors, computers or the like may be included in the installedproduct 102 to control operation of the installed product 102, with orwithout input to the control units, etc., from the modeling module 108.

As used herein, devices, including those associated with the system 100and any other devices described herein, may exchange information via anycommunication network which may be one or more of a Local Area Network(“LAN”), a Metropolitan Area Network (“MAN”), a Wide Area Network(“WAN”), a proprietary network, a Public Switched Telephone Network(“PSTN”), a Wireless Application Protocol (“WAP”) network, a Bluetoothnetwork, a wireless LAN network, and/or an Internet Protocol (“IP”)network such as the Internet, an intranet, or an extranet. Note that anydevices described herein may communicate via one or more suchcommunication networks.

A user may access the system 100 via one of the user platforms 112(e.g., a personal computer, tablet, or smartphone) to view informationabout and/or manage an installed product 102 and/or develop models andplatforms in accordance with any of the embodiments described herein.According to some embodiments, an interactive graphical displayinterface may let a platform developer develop a platform and a modeldeveloper develop models, define and/or adjust certain parameters and/orprovide or receive automatically generated recommendations or results.

Turning to FIG. 2, the high-level architecture (e.g., platform) 200 ofthe system 100 is provided, in accordance with some embodiments. In someembodiments, the platform 200 may host or include an interface server202, a core server 204, storage 206, an analytic server 208, and amodeling technique registry 210.

In some embodiments, the interface server 202 may include anauthentication/authorization module 212. Theauthentication/authorization module 212 may be programmed toauthenticate at least one of a model developer and platform developerand authorize at least one of the model developer and the platformdeveloper to develop and execute models for the system 100,respectively. In some embodiments, the authentication module 212, inconjunction with application specific access controls, may be used tocontrol both access to the system (authentication) and operations adeveloper may be allowed to perform within the system (authorization).The interface server 202 may also include an interactive graphical userinterface display 214 (e.g., web application) according to someembodiments. The display 214 may include an area 502 (FIG. 5) to developmodels, as described herein. In some embodiments, within the platform200, one or more interface servers 202 may be coupled to, and mayprovide programmatic or web interfaces 214 to one or more core server(s)204.

In one or more embodiments, the core server 204 may host one or moreapplications or modules (e.g., Report Module 216, File Module 218, TaskModule 220, and Data Module 222). In some embodiments, the applicationsor modules may be micro-services. In one or more embodiments, the ReportModule 216 may allow specific reports to be retrieved from the storage206.

In one or more embodiments, the Task Module 220 may be a task manager,and may start/stop/get the status of any model-related task. In one ormore embodiments, the Task Module 220 may: prepare an input file foranalysis; trigger the execution module 232 to run the model; update thetask status; parse the model output and register the input and outputartifacts with a database.

In one or more embodiments, the Data Module 222 may provide access tovarious specific persistent storage elements. The core server 204 is, inturn, shown to be coupled to one or more memories/storage 206. In one ormore embodiments, the storage 206 may be a persistent storage. In one ormore embodiments, the storage 206 may be an external storage element.The storage 206 may include at least one of one or more relationaldatabases (e.g., SQL store) 224, one or more NoSQL or non-relationaldata stores (e.g., NoSQL stores) 226, and one or more Binary LargeOBject (BLOB) Stores 228. In one or more embodiments, the non-relationaldata store 226 may include one or more data tables that may index modelmetadata for facilitating searching and accessing via the model. In oneor more embodiments, the storage 206 may include an interface 229, whichmay be used to communicate with an element outside of the platform 200.In some embodiments, the platform 200 may be extended to use storage 206like Hadoop, Time Series, Triple store, and other suitable storage.

In some embodiments, the analytic server 208 may host an artifact module230, an execution module 232 and a container module 234.

In some embodiments, the tasks or models developed in the task module220 may be executed by the execution module 232. In one or moreembodiments, this execution may be remote. In some embodiments, theexecution module 232 may: execute arbitrary shell commands on a hostoperating system; invoke a Docker-based model (or any other suitablemodel) when the shell command is a bash script; be secured with HTTPSclient certificate authentication, send execution status updates to thetask module 220.

In one or more embodiments, the artifact module 230 may be a distributedservice for provisioning, collecting, extracting and the persistence ofartifacts required or produced by execution of model tasks. An artifact1200 (FIG. 12) may be any piece of electronic data that is stored insome sort of file (e.g., text, binary, numbers, logs, a compiledexecutable, etc.). As shown in FIG. 12, data sources 1202 (e.g., MDAP,Data Lake, User CSVs) as well as model files 1204 (e.g., metrics, logs,input information, models, output information) may have data that may beindexed by the artifact module 230. In one or more embodiments, themodel 236 may have information indexed by the artifact module 230because the co-efficients of the model may be stored elsewhere. In oneor more embodiments, as shown in FIG. 13, the artifact module 230 mayreceive artifacts from the BLOBstore 228, the data module 222, the taskmodule 220, the file module 218 and the modeling technique registry 210,and may transport the artifacts 1200 to any of the BLOBstore 228, thedata module 222, the task module 220, the file module 218 and themodeling technique registry 210. In one or more embodiments, theartifact module 230 may: fetch input artifacts 1200 and store them asfiles on temporary file storage, accessible by the model; uploadartifacts 1200 output by the model to the artifact module 230; and runfrom bash shell scripts invoked by the execution module 232. Prior toexecution, the artifact module 230 may provision the necessary artifacts1200 in a temporary locally accessible path to allow the models 236, andother software, to run the same in a local development environment and aproduction/execution environment. In one or more embodiments, when themodel developer develops a model, the model developer may use locallystored data and other files/artifacts. By providing all necessary datafiles and other artifacts locally, the Artifact Module 230 may allow themodel to execute the same way in the production environment as when itwas being developed in the development environment. In some embodiments,when the software completes its task, the Artifact module 230 may alsobe responsible for collecting the produced artifacts from the temporaryworkspace (not shown) and persisting them in permanent storage 206.

In some embodiments, the execution module 232 may turn any model (e.g.computational operation or shell command) into a Representational StateTransfer (REST) web service. REST web services may refer to anarchitectural style and communication approach that may be easy toconsume by other applications via their web Application ProgrammingInterface (API). In one or more embodiments, turning a model into a webservice may be described as publishing the model 236 in the form of aREST end point. The REST end point form may make the model 236 easy touse by other services or applications (e.g., in a cloud environment). Inone or more embodiments, the platform 200 may include a log module (notshown) that may store log entries into a triple store when invoked viathe REST. In some embodiments, the inputs to the model 236 may betransmitted to the task module 220 from the execution module 232 inorder for the technique container to be executed. In some embodiments,the transmission may be asynchronously executed. As used herein in thisregard, “asynchronous execution” means that the requesting module is notwaiting for the task to be completed by the execution model 232.Instead, in some embodiments, the requesting module sends a request,specifying a call-back end point where the requesting module wants toreceive information when there is an update about the status of thetask. For example, in some embodiments, the requesting module mayeffectively say to the execution module “do this task (x) and call meback at the following address (y) when you are done.”

In one or more embodiments, as will be further described below, theexecution module 232 may execute at least one task. In one or moreembodiments, the model 236 is created by executing a collection oftasks. Some examples of tasks that the execution module may execute arebuilding a model, predictions using a model, estimating missing data,generating space filling designs. Other suitable tasks may be used. Inone or more embodiments, the execution module 232 may execute the taskslocally and externally. For example, in some instances, tasks may belocal to the execution module 232 and the work may happen locally (e.g.,a local small model build or a model prediction), however in otherinstances the task may require the job to be run elsewhere (e.g., amassively parallel Hadoop instance or a High Performance Computing (HPC)environment like CRAY).

The output (e.g., model as a REST web service) of the execution module232 may be received by the container module 234 in some embodiments. Asused herein, in some embodiments, the “output” may refer to one or moreoutputs. In some embodiments the container module 234 may wrap eachanalytic model 236 in a complete filesystem that may contain everythingneeded to run the model (e.g., code, runtime, system tools, systemlibraries, and anything that may be installed on a server). In one ormore embodiments, the complete filesystem may be referred to as anApplication Programming Interface (API) wrapper 201. In one or moreembodiments, the analytic model 236 may be formed from one or morecomponent- or sub-models, as described further below. Each of the modeland component models may have its own API wrapper 201. The inventorsnote that containerizing the model may allow the model to run the same,regardless of the environment, and may also allow the components of themodel, and the model itself, to run independently such that if onecomponent of the model fails, the whole model does not fail. Theinventors further note that containerization may also contribute toresilience toward failures of the underlying infrastructure. Forexample, if the hardware (physical or virtual) that the container isrunning on fails while the task is being executed, the system mayrestart the same container on a different computer node to allow thetask to complete. While Docker containers may be described herein, anyother suitable containers may be used (e.g., springboot, NodeJS, AngularJS, cloud foundry, etc.).

In one or more embodiments, when the analytic model is executed (e.g.,runtime analytic deployment), a containerized model 236 may beregistered and stored in the modeling technique registry 210. Inresponse to deployment, in some embodiments, the modeling techniqueregistry 210 may register the new containerized model 236 on theplatform 200.

In one or more embodiments, each element in the platform 200 (e.g.,interface server 202, core server 204, storage 206, analytic server 208and modeling technique registry 210), as well as each sub-element (e.g.,authentication/authorization module 212, user interface/web application214, report module 216, file module 218, task module 220, data module222, relational databases (e.g., SQL store) 224, NoSQL or non-relationaldata stores (e.g., NoSQL stores) 226, Binary Large OBject (BLOB) Stores228, interface 229, artifact module 230, execution module 232, containermodule 234, and analytic model 236), may also be associated with an APIwrapper 201. As for the API wrapper associated with the model 236, eachAPI wrapper 201 associated with each element and sub-element of theplatform 200 may define the input information (input, source of input)to the element/sub-element, at least one instruction defining a functionof the element/sub-element and the output information (output,destination of output) from the element/sub-element. In one or moreembodiments, inputs sources may be any file type (e.g., comma separated,tab separated, binary, etc.), relational databases (e.g., Oracle),non-relational databases (e.g., NoSQL), large data stores (e.g., Hadoop)or streaming sources (e.g., twitter). As such, the API wrapper 201 mayallow each element and sub-element in the platform 200 to be“self-aware” and “self-registering.” As used herein, in one or moreembodiments, “input” may refer to one or more inputs and “output” mayrefer to one or more outputs.

In one or more embodiments, the platform element's and sub-element'sability to know the input information 203 (e.g., inputs, the source ofthe inputs) and the output information 205 (e.g., outputs and thedestination of the outputs) via the API wrapper 201 may make theelement/sub-element “self-aware.” The inventors note that only the APIwrapper 201 in the user interface/web application 214 sub-element and inthe model 236 sub-element in FIG. 2 shows the input information 203 andoutput information 205, to simplify the figures, as all API wrappers 201may include input information 203 and output information 205.

As used herein, “self-registering” means that the element/sub-elementmay provide information about its contents, working rules andcapabilities via emission of a unique signature (e.g., via the APIwrapper 201) to register itself in any system with valid interface andsecurity settings. In one or more embodiments, the API wrapper 201 maydefine the elements/sub-elements in such a way that they plug themselvesinto the development platform 200 upon completion and may makethemselves available for further development activities. A benefit of“self-registering,” is that the element/sub-element may communicate withanother element, model, or system, for example, about what informationit may need and what information it may provide. In some embodiments,the one or more elements/sub-elements of the platform 200 maycommunicate with each other via the API wrapper 201, because theyinclude the same API wrapper structure (input, function, output), andthe API wrapper structure includes instructions about the destination ofthe output.

In one or more embodiments, each element and sub-element of the platform200 may be complete by itself (e.g., may not need to be part of asystem). Additionally, in one or more embodiments, each element andsub-element of the platform 200 may not need to be configured to be partof another system. Rather, the API wrapper 201 may allow each elementand sub-element to be seamlessly part of another system, as the APIwrapper 201 may provide the inputs/outputs for each element/sub-element,thereby providing the structure for a relationship between theelements/sub-elements of different systems.

Turning to FIG. 11, a diagram of an example of the communication betweenthe sub-elements on the platform 200 is provided. Each sub-element 1100(e.g., authentication/authorization module 212, user interface/webapplication 214, report module 216, file module 218, task module 220,data module 222, relational databases (e.g., SQL store) 224, NoSQL ornon-relational data stores (e.g., NoSQL stores) 226, Binary Large OBject(BLOB) Stores 228, interface 229, artifact module 230, execution module232, container module 234, and analytic model 236) may be executedindependently of each-other, except where they are dependent. Forexample, the sub-elements 1100 indicated by a dark-dotted link 1102 maybe dependent on the fs (file module) sub-element 218. In one or moreembodiments, each sub-element 1100 may be configured to runindependently or as part of a bigger system. In one or more embodiments,the fact that each sub-element 1100 may be run independently may allowthe sub-element to be run on any system or platform with a suitable APIinterface. For example, the sub-element may seamlessly be run on anexecution platform 333 (FIG. 3A), because the execution platform 333 iswritten in the same manner as the development platform (e.g., with asame or similar API wrapper structure). In one or more embodiments,self-discoverable units may be the individual components that make upthe execution platform. For example, the analytic container is aself-discoverable unit. In one or more embodiments, the sub-elements1100 may be individual items anchored to the repository 310, and thesub-elements 1100 may be pulled by the artifact module 230, for example,when they are needed in the development of the platform 308. In one ormore embodiments, the platform developer may define the developmentenvironment variables for orchestrating individual actions.

Turning back to FIGS. 3A and 3B, an example of an analytic model 236 andan external platform 333 are provided. As used herein, the terms“external platform” and “external system” may be used interchangeably torefer to a platform/system outside of a development platform 308. Insome embodiments, there may be no distinction between a developmentenvironment and a development platform 308. Conventionally, adevelopment environment is distinct from a platform, whereby thedevelopment environment includes modifiable code and the platformincludes code for execution but not modification. Conventionally, when amodel developer develops a model in the development environment, theyhave to determine if they are using the latest code that is compatiblewith a model that will be run on the platform. Then, conventionally, themodel developer determines all of the blocks (e.g., compiler, editor,data stores repositories, linked libraries, static libraries,dependencies), needed to install and run the model in the platform.

In one or more embodiments, some portion or all of the code for thedevelopment platform 308 (e.g., the code for the platform, components torun the code (e.g., compilers, linkers, packagers), to manage (e.g.,editor, timing checks), test and debug the code), as well as arepository (not shown) may be populated for the model developer when thedevelopment platform is generated. The inventors note that providing allof the elements of the platform in the development environment,development and deployment of models may be much faster because themodel developer may just focus on creating the model and may not have todetermine the platform specifics and dependencies of platform elementsto execute the model. For example, embodiments may provide for adeployment time of models that may be 10 times faster than conventionaldeployment. The inventors also note that while conventionally it maytake 2-6 weeks' time to set up a new model developer with a developmentenvironment before they may begin creating or developing the models,embodiments may allow for model developer set-up in about an hour and ahalf. Embodiments may provide for the seamless and independentintegration of developed system elements of the platform, as eachelement of the platform is self-aware and self-registering, as describedbelow. Embodiments provide an integrated system for development, testingand deployment. For example, in one or more embodiments, the system mayprovide all necessary items for the developer to develop the code, testit with standard datasets and test cases and validate their new code andthen deploy the code into the platform and test it in the platform. Inone or more embodiments, unit testing and regression testing tools maybe provided to the developers along with development tools.

In one or more embodiments, the model developer may use the userinterface/web application 214 to develop the model 236. Development ofthe model 236 may include a kernel 301 (e.g., a building block ofmodels). The kernel 301 may be the functional form of a model withgeneric co-efficients. For example, y=a*x+b is a kernel 301 withcoefficients a and b; and T_(metal)=N*(T_(hot)−T_(cold)) is a kernelwith coefficient N. In one or more embodiments, the kernel 301 and data303 may be received by a technique 305. In one or more embodiments, datamay come from a variety of sources, such as operationally measuredparameters, observed inspection data, etc. In one or more embodiments,the technique 305 may be a solution methodology, in general. In one ormore embodiments, with respect to a module build or update, thetechnique 305 may be the “method” that generates the specific values ofthe coefficients in the kernel. For example, Regression, ANN and PCE,etc. may be several techniques for building data-driven models; EKF,UKF, Particle filters, Bayesian updating, etc. may be model updatingtechniques; BEST analysis, Area metric, etc. may be data comparisontechniques; and OLH, RLH, CCD etc. may be DOE generation techniques. Inone or more embodiments, the model 236 may codify a relationship betweeninputs and outputs. The model 236 may be developed from one or morekernels 301 by estimating the values of coefficients in the Kernels 301,through the technique 305, to fit data 303. In one or more embodiments,the model 236 may be a fully specified mathematical representation ofthe relationship between the inputs and outputs. For example, thecoefficients in the kernel y=a*x+b may be estimated through Bayesianestimation to form a model y=1.2*x+0.5

In some embodiments, the model 236 may include coefficients 604 (FIG.6), inputs 304, outputs 306, a security layer 307, a subscription layer309, a prediction API 311, an updating API 313, a metrics/logging API315, and a deployment settings 317. In one or more embodiments, the oneor more co-efficients, the one or more inputs, the one or more outputs,the security layer, the subscription layer, the prediction API, theupdating API, the metrics/logging API, and the deployment settingsmodule may be integrated by the model API 201. In one or moreembodiments all of (one or more co-efficients, the one or more inputs,the one or more outputs, the security layer, the subscription layer, theprediction API, the updating API, the metrics/logging API, and thedeployment settings module) may act as “input information” in the APImodel.

In one or more embodiments, the security layer 307 may secure the model236 at all levels; and may allow segmented access to different parts ofthe model 236. For example, users may have the ability to use the model236 without having any access to coefficients.

In one or more embodiments, the subscription layer 309 may allow the useof the models 236 for a specified number of uses or for a specifiedamount of time. In some embodiments, the subscription layer 309 mayenable renewals to use of the model, and may provide forself-destruction of the model after a limited use.

In one or more embodiments, the prediction API 311 may provide thecapability to make predictions using the model 236. In some embodiments,the prediction API 311 may be combined with security layer 307 and thesubscription layer 309 to define what predictions are enabled. Forexample, if a model is y=a*x+b*z+c*w, the prediction API 311 may be setsuch that the user may only see the following: 1. Y=f(x) where the usermay only enter values for x; and/or 2. Y=a*x+c*w+g( . . . ) where theuser may see there are two inputs, x and w, with specific co-efficients,etc.

In one or more embodiments, the updating API 313 may provide thecapability to update the model 236 with new data. In some embodiments,the updating API 313 may be combined with the security layer 307 and thesubscription layer 309 to define what updates may be enabled, similar tothe prediction API 311.

In one or more embodiments, the metrics/logging API 315 may providemetrics of the model 236 as newer predictions are made (i.e., as newinputs are provided to the model for predictions). In some embodiments,logging of actions may be provided as the model is used for any purpose.

In one or more embodiments, the deployment settings 317 may allow themodel 236 to be deployed in a variety of systems. For example, the samemodel may be deployed on an edge device and on a high performancecomputing infrastructure. Based on the deployment settings, the model236 may decide whether it runs fast (e.g., because of reducedcomputations resources on the edge) or run in full mode. Depending onthe settings, different security and subscription settings 307, 309 maybe automatically triggered. In some embodiments, this may enable modelflexibility and may allow the model to self-optimize to specificenvironments and requirements.

In one or more embodiments, the deployment settings 317 may include amodel hypervisor 319. In some embodiments, the model hypervisor 319 maybe a virtual machine manager that may manage operations between thedevelopment platform 308 and one or more external platforms 333. In oneor more embodiments, the model hypervisor 319 includes its own API andit interfaces with the model API.

In one or more embodiments, the model 236 may be executed on theexternal platform 333. In one or more embodiments, the model 236 may beexecuted from the development platform 308.

In some embodiments the model hypervisor 319 may include a memory usageby model fidelity module 321, a CPU by usage model fidelity module 323,a parallel vs serial settings model 325, a model status collector 327, amodel status communicator 329, and a garbage collection module 331. Inone or more embodiments, model fidelity may refer to the quality (orversion) of the model required. For example, if a highly accurate modelis desired, the model building process may need to be run on a highperformance computing environment because it needs large computingresources. On the other hand, if a simplified approximate model issufficient, then the model build process may be executed on a “cheaper”computer that has lower CPU and memory capability.

In one or more embodiments, the model hypervisor 319 may execute theparallel vs serial settings model 325 to determine whether to enableparallel execution or serial execution of model build, model prediction,data estimation algorithms etc. In one or more embodiments, the modelhypervisor 319 may determine whether to enable parallel execution basedon the external platform 333 capabilities and the analytic model 236requirements. For example, if a highly accurate model is desired, themodel building process needs to be run on a parallel high performancecomputing environment because it needs large computing resources. On theother hand, if a simplified approximate model is sufficient, then themodel build process can be executed on a “cheaper” serial computer thathas lower CPU and memory capability. In one or more embodiments, ifparallel execution is enabled, the model hypervisor may choose to splitone large problem into many smaller problems that are interconnected(memory parallel) or detect that the problem is a collection of smallerNON connected (independent) problems that can be solved independently(embarrassingly parallel). In one or more embodiments, if the modelhypervisor 319 enables parallel execution, the analytic model 236 may beexecuted and may assemble the results of the execution.

In one or more embodiments, the model status communicator 329 may be alayer in the model hypervisor 319 responsible for communicating with theexternal system 333. In one or more embodiments, another layer in thedevelopment platform may enable this communication. For example, thetask module 220 may communicate with the execution module 232 and theexecution module 232 may communicate with the analytic model 236.

In one or more embodiments, the temporary files may be stored intemporary or permanent locations. In one or more embodiments the garbagecollection module 331 may know to go and clean up temporary files fromall locations. Based on the security settings, in some cases, none ofthe temporary files may be cleaned up. For example, if a particularcustomer requires all their files to be retained, the system may be setto not delete/remove any files associated with that customer.

In one or more embodiments, the analytic model 236 may include one ormore functional components 302 (FIG. 3B), hereinafter referred to as“component models”. In some embodiments, each component model 302 mayrepresent a different function or task that may be executed as part ofthe execution of the analytic model 236.

For example, each of data ingestion, data cleaning and executing theanalytic may be component models. Other suitable component models may beused. In one or more embodiments, each of the component models 302 maybe independent and complete by itself and may not need to be part of asystem.

In one or more embodiments, each of the component models 302 may knowwhat its inputs are and what its outputs are. For example, if thecomponent model is y=x+ab, the component model 302 may know that “x” isthe input, “ab” are the coefficients and “y” is the output. Thecomponent model 302 may also know where input is coming from (e.g., oneor more sources) and where the output is going (e.g., one or moredestinations). In some embodiments, the source may be a file, a datastream, a data warehouse, a user and a database. Other suitable datasources may be used.

In one or more embodiments, the input and output may be in a JSON formator any other suitable format. The inventors note that while standardizedinputs and outputs in any form that may be applicable to programminglanguages may be used, the use of a JSON format may be beneficial as itis a standard that may be supported by many programming languages and itmay allow representation of all required and optional information neededfor the running of any model. JSON format may also be flexible byallowing new information to be added without having to change theunderlying software. In one or more embodiments, there may be more thanone output. In some embodiments, at least one output may be a JSON file,while the other outputs may be other file types. In one or moreembodiments, the one JSON output is what the system may expect in orderto collect information regarding the outcome of the task. Again due tothe generality of the JSON format, different models may includemodel-specific information in the JSON document. Any markup language mayalso be used. Many types of outputs (which may be used as inputs in someaspects) may also be generated such as binary formats such as Matlab.mat files, Python pickle files etc. Other suitable formats may be used.

In one or more embodiments, input information 304 (e.g., the input andsource of the input) and output information 306 (e.g., output anddestination) may be stored in, or encoded by, an application programminginterface (API) wrapper 308 that may be associated with the componentmodel 302. In some embodiments, the API wrapper 308 may be associatedwith the component model 302 per the definition of the API. In someembodiments, the API may include standard elements (e.g., inputinformation, modeling technique, output information). In one or moreembodiments, the API may include the modeling technique/the process tocreate a model. In one or more embodiments, the API may define themodel, but the model may be completed with its elements that are outsidethe API (e.g., coefficients and terms). In one or more embodiments, theAPI may include other suitable standard elements. Together, thecomponent model 302 and the API wrapper 308 may form a component 310. Inone or more embodiments, the platform (e.g., system architecture) 200may not accept the component 310 unless the standard elements (e.g.,input information, modeling technique, output information) of the APIare defined. In one or more embodiments, the component model's 302ability to know the inputs, the source of the inputs, the outputs andthe destination of the outputs via the API wrapper 308 makes thecomponent 310 “self-aware.” In one or more embodiments, metadata 313 forthe component 310 may be stored in the component 310 when the componentis running. In some embodiments, for the component 310 to be self-aware,the component may also pull metadata 313 from the storage element 206(e.g., non-relational data stores 226). In some embodiments, since thecomponent 310 knows what its inputs should be and their source, thecomponent 310 may pull the inputs from the sources, as needed.

Conventionally, models may not know what data they will receive or thesource of the data, and the models also may not know where the output ofthe model is going. Rather, conventionally, each time the model isexecuted, the input, source, and output destination may be specified,which may be time-consuming and error-prone, as a user may not be surewhat information to specify. The inventors note that in embodiments, thecomponent 310 defines the input information and output information aspart of the component 310 package, facilitating deployment andmanagement of the model 236. In some embodiments, for a model developerto make use of the model 236 (and the associated components 310), theinput information 304 and output information 306 may be defined prior touse.

In one or more embodiments, the component 310 may include an integratedself-test 311. The self-test 311 may help maintain the health of thesystem, and may also facilitate integrating new modeling techniques inthe system. In one or more embodiments, the self-test 311 may allow themodels to check themselves periodically with new and existing datasetsand trigger corrective actions to update the model if the model qualitydeviates beyond defined thresholds.

In one or more embodiments, the component 310 may also be“self-registering”. As used herein, “self-registering” means that thecomponent 310 may provide information about its contents, working rulesand capabilities via emission of a unique signature (e.g., via the APIwrapper 308) to register itself in any system with valid interface andsecurity settings. A benefit of “self-registering,” is that thecomponent 310 may communicate with another component, model, or system,for example, about what information it may need and what information itmay provide. In some embodiments, the one or more components 310 maycommunicate with each other via the API wrapper, because they includethe same API wrapper structure (input, model, output), and the APIwrapper structure includes instructions about the destination of theoutput.

In one or more embodiments, each component 310 may be self-aware, andthen the self-aware components may form a self-aware analytic model 236,which may, in turn, be combined with other models to form a bigger modeland system. In some embodiments, each of the one or more components 310(e.g., a plug-in, add-in or macro) may add a specific service or featureto a larger model.

FIG. 4 illustrates a process of operation 400 that may be performed bysome or all of the elements of the system 100 and platform 200 describedwith respect to FIGS. 1 and 2. Process 400 and other processes describedherein may be performed using any suitable combination of hardware(e.g., circuit(s)), software or manual means. For example, acomputer-readable storage medium may store thereon instructions thatwhen executed by a machine result in performance according to any of theembodiments described herein. Software embodying these processes may bestored by any non-transitory tangible medium including a fixed disk, afloppy disk, a CD, a DVD, a Flash drive, or a magnetic tape. Examples ofthese processes will be described below with respect to embodiments ofthe system, but embodiments are not limited thereto. In one or moreembodiments, the system 100 is conditioned to perform the process 400such that the system is a special-purpose element configured to performoperations not performable by a general-purpose computer or device. Theflow charts described herein do not imply a fixed order to the steps andembodiments of the present invention may be practiced in any order thatis practicable.

Initially, at S410, an analytic model 236 may be provided for aninstalled product 102. Then at S412 an execution platform 333 may beprovided on which to run the analytic model 236. In S414, an API wrapper201 may be provided for each of the analytic model 236 and the executionplatform 333. As described herein, in one or more embodiments, the APIwrapper 201 may define the input information (input, source of input) tothe model/execution platform, at least one instruction defining afunction of the model/execution platform and the output information(output, destination of output) from the model/execution platform. Assuch, the API wrapper 201 may allow each model 236 and executionplatform 333 to be “self-aware” and “self-registering.”

Then in S416, the analytic model 236 may be deployed or exported to theexecution platform 333. In one or more embodiments, the externalplatform 333 may provide information about its capabilities to the modelhypervisor 319 via the output of the execution platform's API wrapper201. In one or more embodiments, the output of the execution platform'sAPI wrapper 201 may be the input expected by the analytic model 236 asdefined in the model API wrapper, such that the model 236 and executionplatform may communicate and function together. The inventors note thatby deploying the analytic model 236 to the execution platform 333 viacommunication between each of their respective API's is beneficialbecause the model developer does not need to specialize or modify theirmodel for a specific executing environment.

In one or more embodiments, the model hypervisor 319 may determine,based on this output information, what fidelity of analytic model 236 toexecute on the external platform 333, using settings in the modelhypervisor 319. As described above, model fidelity may refer to thequality of the model required. For example, if a highly accurate modelis desired, the model building process may need to be run on a parallelhigh performance computing environment because it needs large computingresources. On the other hand, if a simplified approximate model issufficient, then the model build process may be executed on a “cheaper”serial computer that has lower CPU and memory capability.

Then in S418, the analytic model 236 may be executed on the executionplatform S418.

Turning to FIG. 5, a graphical user interface for development of ananalytic model 236 that may be generated on the platform 308 is providedaccording to some embodiments. The user interface 214 may include anarea 502 to develop the models. In one or more embodiments, the model236 may be made from one or more component models (not shown), thattogether form the model 236. A component model may be an individualmodel that may work with one or more other component models to form themodel. For example, a first component model may be an ingestion modeland a second component model may be a data cleaning model. As usedherein, the term “model” may refer to either the model 236 or thecomponent models. The model 236 may include equations 504 inserted(e.g., via drag and drop functionality) from an equation library 506, ordeveloped by the model developer without the use of the equation library506. In developing the model, the model developer may use other suitablelibraries 508 (e.g., Usage Based Lifing library, Scipy library, KDLSparklgraph library, etc.). In one or more embodiments, the libraries508 may be stored in the repository 310. After the model developer hasincluded the desired equations in the area 502, and linked 501 them asdesired, the model developer may select an integrate tab 510 tointegrate the equations together to form the model.

As used herein, the model is the action or task to perform with receivedinputs. For example, a task of a data ingestion model may be to funneldata to a next model; and a task of a data cleaning model may be toclean the input data (e.g., remove noise, determine if any data ismissing, check for anomalies).

In one or more embodiments, an API wrapper 201 may be defined forassociation with the model 236 via execution of the container module234. For example, FIG. 6 provides the interface 214 for the modeldeveloper to define the API wrapper 201. As described above, the APIwrapper 201 may store or encode input information 203 (e.g., the inputand source of the input) and output information 205 (e.g., output anddestination) that may be associated with the model 236. In one or moreembodiments, after the model 236 is created, when the model 236 iscompiled, the model 236 knows where to pull the inputs from per the APIwrapper 201, even if the model developer does not have access to thoseinputs. In one or more embodiments, the developer may also defineco-efficients 604 and constants 606. In one or more embodiments, thedeveloper may link each variable 602 to a data header (not shown) in thecode. For example, the developer may include an instruction in the modelto write to database X, and the model will get the information fromdatabase X during execution of the model, but the developer may notactually see the contents of the database.

In some embodiments, the API wrapper 201 may include standard elements(e.g., input information, modeling technique, output information). Inone or more embodiments, the API wrapper 201 may include the modelingtechnique/the process to create a model. In one or more embodiments, theAPI wrapper 201 may define the model, but the model may be completedwith its elements that are outside the API wrapper 201 (e.g.,coefficients and terms). In one or more embodiments, the API wrapper 201may include other suitable standard elements.

In one or more embodiments, the model's 236 ability to know the inputinformation 203 (inputs, the source of the inputs) and the outputinformation 205 (outputs, the destination of the outputs) via the APIwrapper 201 may make the model 236 “self-aware.” In one or moreembodiments, metadata 313 for the model 236 may be stored in the model236 when the model 236 is running. In some embodiments, for the model236 to be self-aware, the model may also pull metadata 313 from thestorage element 206 (e.g., non-relational data stores 226). In someembodiments, since the model 236 knows what its inputs should be andtheir source, the model 326 may pull the inputs from the sources, asneeded.

Conventionally, models may not know what data they will receive or thesource of the data, and the models also may not know where the output ofthe model is going. Rather, conventionally, each time the model isexecuted, the input, source, and output destination may be specified,which may be time-consuming and error-prone, as a user may not be surewhat information to specify. The inventors note that in embodiments, theAPI wrapper 201 associated with the model 236 defines the inputinformation and output information, facilitating deployment andmanagement of the model 236. In some embodiments, for a model developerto make use of the model 236, the input information 203 and outputinformation 205 may be defined prior to use.

In one or more embodiments, the self-aware model 236 may also be“self-registering”. As used herein, “self-registering” means that theself-aware model 236 may provide information about its contents, workingrules and capabilities via emission of a unique signature (e.g., via theAPI wrapper 201) to register itself in any system with valid interfaceand security settings. A benefit of “self-registering,” is that themodel 236 may communicate with another component, model, or system, forexample, about what information it may need and what information it mayprovide. In some embodiments, the one or more models 236 may communicatewith each other via the API wrapper 201, because they include the sameAPI wrapper structure (input, model technique, output), and the APIwrapper structure includes instructions about the destination of theoutput.

In one or more embodiments, the modeling module 108 may, via theanalytic server 208, associate the model 236 with the API wrapper 201,as defined by the API wrapper.

In one or more embodiments, an interactive visualization 700 (FIG. 7) ofthe model 236 may be provided in a user interface. In one or moreembodiments, the interactive visualization 700 may be generated afterproviding the equations 504 and defining the input information 203 andoutput information 205 (e.g., variables 602), as well as thecoefficients 604, and constants 606 (FIG. 6). In one or more embodimentsall of the information entered in the equation 504 may be included inthe interactive visualization. In one or more embodiments, the modeldeveloper may dynamically change the plot 702 to see how the changesaffect the results. For example, in one or more embodiments, the modeldeveloper may change the co-efficient and constants by dragging themfrom the variables 602 or entering values. In one or more embodiments,each co-efficient 604 may have an upper and lower bound as text inputs.In one or more embodiment, each constant 606 may have at least one textinput. In one or more embodiments, after the model developer issatisfied with the model, per the interactive visualization 700, themodel developer may select a “train model” indicator 704. While a buttonindicator is used to select “train model,” any other suitable indicatormay be used. After selection of the “train model” indicator, the system100 may then train the model (e.g., compute the value of eachco-efficient 604).

Turning to FIGS. 8 and 9, a user interface for registering themodel/technique 800 and results 900 is provided, respectively. In one ormore embodiments, registration of the technique may occur before themodel is created so that a model developer may then go choose thetechnique to build the model. In one or more embodiments, registeringthe technique may enable any code to be added by a developer (typicallyan advanced user) may develop a technique based on their own expertiseand then may use the system's API definitions to “wrap” their techniquein a provided docker container. In one or more embodiments, this mayinclude providing build scripts for building the container for the newanalytic and executing the containers. Then, using the interface shownin 900, the technique developer may set the input and output pages forthe technique along with the command required to run the technique. Oncethe registration is successfully completed and the technique is approvedfor use, the technique may come up in list of available techniques forany user to build models.

After the technique 800 is registered, the model developer may alsoregister a results template 902 to provide a structure for the resultsof execution of the model technique. For example, the template 902 mayinclude one or more fields 904 that may be populated with information.As shown in FIG. 9, for example, the fields 904 may include a label forthe results, a description, a plot title, a chart type, a mode, a datasource, an indication if the data source an array, an indication if anarray item is an object, an X value accessor a y-value accessor, and adisplay width. In one or more embodiments the information to populatethe fields may be selected from at least one of drop-down menus (e.g.,chart type, mode, data source, display width), user-entry fields (e.g.,label, description, plot title), selection of boxes or radio buttons(data source is array, array item is object), and selectable fromanother source (e.g., X value accessor, y value accessor). In one ormore embodiments, the results template 902 may include a preview of theoutput 906 of the model technique.

Note the embodiments described herein may be implemented using anynumber of different hardware configurations. For example, FIG. 10illustrates an analytic development and processing platform 1000 thatmay be, for example, associated with the systems 100, 200 of FIGS. 1 and2, respectively. The analytic development and processing platform 1000comprises an analytic and development processor 1010 (“processor”), suchas one or more commercially available Central Processing Units (CPUs) inthe form of one-chip microprocessors, coupled to a communication device1020 configured to communicate via a communication network (not shown inFIG. 10). The communication device 1020 may be used to communicate, forexample, with one or more users. The analytic development and processingplatform 1000 further includes an input device 1040 (e.g., a mouseand/or keyboard to enter information about the installed product or themodel) and an output device 1050 (e.g., to output and display the dataand/or recommendations).

The processor 1010 also communicates with a memory/storage device 1030.The storage device 1030 may comprise any appropriate information storagedevice, including combinations of magnetic storage devices (e.g., a harddisk drive), optical storage devices, mobile telephones, and/orsemiconductor memory devices. The storage device 1030 may store aprogram 1012 and/or analytic development and processing logic 1014 forcontrolling the processor 1010. The processor 1010 performs instructionsof the programs 1012, 1014, and thereby operates in accordance with anyof the embodiments described herein. For example, the processor 1010 mayreceive a component model and then may apply the modeling module 108 viathe instructions of the programs 1012, 1014 to generate an analyticmodel 236.

The programs 1012, 1014 may be stored in a compressed, uncompiled,compiled and/or encrypted format. The programs 1012, 1014 mayfurthermore include other program elements, such as an operating system,a database management system, and/or device drivers used by theprocessor 1010 to interface with peripheral devices.

As used herein, information may be “received” by or “transmitted” to,for example: (i) the platform 1000 from another device; or (ii) asoftware application or module within the platform 1000 from anothersoftware application, module, or any other source.

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

It should be noted that any of the methods described herein can includean additional step of providing a system comprising distinct softwaremodules embodied on a computer readable storage medium, the modules caninclude, for example, any or all of the elements depicted in the blockdiagrams and/or described herein; by way of example and not limitation,a modeling module. The method steps can then be carried out using thedistinct software modules and/or sub-modules of the system, as describedabove, executing on one or more hardware processors 1010 (FIG. 10).Further, a computer program product can include a computer-readablestorage medium with code adapted to be implemented to carry out one ormore method steps described herein, including the provision of thesystem with the distinct software modules.

This written description uses examples to disclose the invention,including the preferred embodiments, and also to enable any personskilled in the art to practice the invention, including making and usingany devices or systems and performing any incorporated methods. Thepatentable scope of the invention is defined by the claims, and mayinclude other examples that occur to those skilled in the art. Suchother examples are intended to be within the scope of the claims if theyhave structural elements that do not differ from the literal language ofthe claims, or if they include equivalent structural elements withinsubstantial differences from the literal languages of the claims.Aspects from the various embodiments described, as well as other knownequivalents for each such aspects, can be mixed and matched by one ofordinary skill in the art to construct additional embodiments andtechniques in accordance with principles of this application.

Those in the art will appreciate that various adaptations andmodifications of the above-described embodiments can be configuredwithout departing from the scope and spirit of the claims. Therefore, itis to be understood that the claims may be practiced other than asspecifically described herein.

The invention claimed is:
 1. A system comprising: an analytic model foran installed product, wherein the analytic model comprises one or moreco-efficients, one or more inputs, one or more outputs and deploymentsettings; an execution platform configured to execute the analyticmodel; an application programming interface (API) wrapper associatedwith each of the analytic model and the execution platform, the APIwrapper including input information, output information and a technique;and a storage in communication with the analytic model and the executionplatform and storing program instructions to perform the functions asfollows: transmitting information between the analytic API wrapper andthe execution platform API wrapper; and deploying the analytic model tothe execution platform based on the transmitted information.
 2. Thesystem of claim 1, wherein the analytic model is hosted on a developmentplatform.
 3. The system of claim 2, wherein the development platform isdistinct from the execution platform.
 4. The system of claim 1, whereinthe analytic model further comprises: Information indicating at leastone of a security layer, a subscription layer, a prediction API, anupdating API, and a metrics/logging API.
 5. The system of claim 1,wherein the one or more co-efficients, the one or more inputs, the oneor more outputs, the security layer, the subscription layer, theprediction API, the updating API, the metrics/logging API, and thedeployment settings module are integrated by the model API.
 6. Thesystem of claim 1, wherein the deployment settings module furthercomprises: a model hypervisor configured to receive the executionplatform API wrapper.
 7. The system of claim 1, further comprising oneor more fidelities of the analytic module.
 8. The system of claim 6,wherein the model hypervisor is configured to decide which fidelity ofthe analytic model to execute on the execution platform.
 9. The systemof claim 6, wherein the model hypervisor includes a memory usage bymodel fidelity module; a CPU usage by model fidelity, a parallel vsserial settings model, a model status collector, a model statuscommunicator, and a garbage collection module.
 10. The system of claim1, wherein the analytic model is self-registering.
 11. A methodcomprising: providing an analytic model for an installed product,wherein the analytic model comprises one or more co-efficients, one ormore inputs, one or more outputs, and deployment settings; providing anexecution platform to execute the analytic model; providing anapplication programming interface (API) wrapper associated with each ofthe analytic model and the execution platform, the API wrapper includinginput information, output information and a technique; and deploying theanalytic model to the execution platform based on communication betweenthe analytic model API wrapper and the execution platform API wrapper.12. The method of claim 11, wherein deploying the analytic model to theexecution platform further comprises: receiving input information at anAPI associated with a model hypervisor of the analytic model from theexecution platform API wrapper.
 13. The method of claim 12, wherein theinput information received at the model hypervisor is output from theexecution platform API wrapper.
 14. The method of claim 11, furthercomprising: defining the API wrapper associated with each of theanalytic model and the execution platform prior to deployment.
 15. Themethod of claim 11, further comprising: executing the analytic model onthe execution platform.
 16. The method of claim 11, further comprising:determining which fidelity of the analytic model to execute on theexecution platform.
 17. The method of claim 11, further comprising:determining whether to enable parallel execution or serial execution.18. The method of claim 17, further comprising: assembling the output ofan executed analytic model on the execution platform if parallelexecution is enabled.
 19. The method of claim 15, further comprising:executing a garbage collection module in response to execution of theanalytic model to at least one of clean and store one or more temporaryfiles and data generated by execution of the analytic model.
 20. Themethod of claim 10, wherein the analytic model is self-registering.